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-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 
Period for Reply 


A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. . 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimunn of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )K Responsive to communication(s) filed on 16 August 2004 . 
2a)n Tiiis action is FINAL. 2b)|EI This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) 13 Claim(s) 1,3-12 and 14-24 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) 13 Claim(s) 7.3-72 and 14-24 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 16 August 2004 is/are: 3)0 accepted or b)|EI objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17,2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 


Attachment(s) 

1) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/IVIail Date . 6) □ Other: . 
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DETAILED ACTION 

Response to Amendment and Arguments 

1 . Applicant's amendment filed on August 16, 2004 has been entered and made of record. 

2. In view of applicant's amendment, the claim objections are withdrawn. 

3. Applicant's arguments with respect to claims 1 and 12 have been considered but are moot 
in view of the new ground(s) of rejection. 

Drawings 

4. The drawings are objected to because figure 3 is of insufficient quality for publication. 

Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

5. Claims 1, 3-5, 7, 12, 14-16, 18 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Chiu et al, U.S. Patent No. 5,696,838 ("Chiu"). 

Referring to claim 1, Chiu discloses a method for detecting a marker in an image, 
comprising the steps of: 


Application/Control Number: 09/8 1 9,2 1 1 Page 3 

Art Unit: 2623 

a. selecting a marker recognition process based on a normalized correlation (col. 5, 
lines 14-17 and col. 8, lines 16-33. Note that the step of utilizing the marker recognition process 
based on a normalized correlation inherently selects it.); 

b. extracting image features associated with an input image of a ROI (region of 
interest) [col. 4, lines 23-59]; 

c. comparing the extracted image features with a trained model associated with the 
selected recognition process to determine if a marker is present in the input image [col. 5, lines 
10-25 and col. 6, lines 15-63]; 

wherein the trained model comprises at least one template image (col. 6, lines 48-63 and 
figure 5) and the step of comparing comprises the steps of: 

i. normalizing the template image and input image with respect to brightness 
(col. 8, lines 16-32), 

ii. computing a correlation between the normalized template image and input 
image (col. 8, lines 16-32), 

iii. determining that a marker is present in the input image if the computed 
correlation meets a threshold (col. 5, lines 30-col. 6, line 13). 

Referring to claim 3, Chiu further discloses that the step of normalizing comprises 

computing /(/) = — , where I(i) is the gray value of pixel I and where u and a denote 

a 

the average brightness and contrast, respectively (col. 8, lines 18-31. Note that the equation in 
lines 21-28 mathematically represents the normalization of the input image according to the 
equation above). 
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Referring to claim 4, Chiu further discloses that the step of computing a correlation 
comprises computing p = ^[/(/) , where P comprises the correlation coefficient, I 

allpixeis 

comprises the input image, and T comprises the template image [col. 8, lines 18-31. Note that 
the terms "li" and "Mi" in lines 21-28 are interpreted as being equivalent to "I(i)" and "T(i)" 
respectively]. 

Referring to claim 5, Chiu further discloses that the at least one template comprises an 
image comprising a target marker, or an image not comprising a target marker, (col. 6, lines 48- 
63. Note that the "perfect 16x16 reference model" in figure 5 contains the entire cross and is 
interpreted as an image comprising a target marker, while the templates in Appendix II that do 
not contain the entire cross is interpreted as an image not comprising a target marker. Note that 
the entire cross is interpreted as the "target marker"). 

Referring to claim 7, Chiu further discloses that the step of computing a correlation 
further comprises computing a correlation between at least one other normalized template image 
and the input image, and determining if a marker is present in the input image based on a 
maximum computed correlation (col. 5, line 30-col. 6, line 14). 

Referring to claim 12, see the rejection of at least claim 1 above. 

Referring to claim 14, see the rejection of at least claim 3 above. 

Referring to claim 15, see the rejection of at least claim 4 above. 

Referring to claim 16, see the rejection of at least claim 5 above. 

Referring to claim 1 8, see the rejection of at least claim 7 above. 
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Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Krumm, U.S. Patent No. 6,61 1,622 ("Krum") and Lee et al., U.S. Patent No. 
6,678,404 ("Lee"). 

Referring to claim 1, Krumm discloses a method for detecting an object in an image, 
comprising the steps of: 

a. selecting an object recognition process based on gray level histograms (col. 2, 
lines 40-61 and col. 19, lines 2-16. Note that the step of utilizing the object recognition process 
based on gray level histograms inherently selects it.) 

b. extracting image features associated with an input image of a ROI (region of 
interest) [col. 8, lines 40-45] 

c. comparing the extracted image features with a trained model associated with the 
selected recognition process to determine if an object is present in the input image (col. 8, lines 
46-62), 

Krumm explains that an object is detected in the image, but does not explicitly disclose 
that the object is a marker. However, the Examiner notes that detecting markers were 
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exceedingly well known in the art. For example, Lee discloses the step of detecting a marker in 
an image based on gray value histograms (coL 5, lines 34-42 and col. 6, lines 40-45). 

Krumm and Lee are combinable because they are both concerned with objection 
detection processes based on gray value histograms. At the time of the invention, it would have 
been obvious to a person of ordinary skill in the art to modify the object of Krumm so that it 
comprises a marker, as taught by Lee. The suggestion/motivation for doing so would have been 
to enhance the flexibility of the system by providing the capability to detect a variety of different 
objects. Therefore, it would have been obvious to combine Krumm with Lee to obtain the 
invention as specified in claim 1 . 

Referring to claim 12, see the (103) rejection of at least claim 1 above. 

7. Claims 6, 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Chiu et al., U.S. Patent No. 5,696,838 ("Chiu") and Kang et al., U.S. Patent No. 
6,03 1,539 C'Kang"). 

Referring to claim 6, Chiu does not explicitly disclose that the template image is 
computed from an average of a plurality of templates. However, this feature was exceedingly 
well known in the art. For example, Kang discloses a template image that is computed from an 
average of a plurality of templates (col. 3, line 65-col. 4, line 7 and figure 6). 

Chiu and Kang are combinable because they are both concerned with image template 
matching techniques. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to modify the template image of Chiu so that it is computed from an 
average of a plurality of templates, as taught by Kang. The suggestion/motivation for doing so 
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would have been to increase the robustness of the recognition process (Kang, col. 4, lines 4-7). 
Therefore, it would have been obvious to combine Chiu with Kang to obtain the invention as 
specified in claim 6. 

Referring to claim 17, see the rejection of at least claim 6 above. 

8. Claims 8 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Chiu et al., U.S. Patent No. 5,696,838 ("Chiu") and Crill et al., U.S. Patent No. 
6,445,822 ("Crill"). 

Referring to claim 8, Chiu does not explicitly disclose the step of reducing the resolution 
of the input image and the template image by a predetermined factor prior to the comparing step. 

Crill discloses the step of reducing the resolution of an input image and a template image 
by a predetermined factor prior to comparing the two images (col. 17, lines 19-26 and col. 21, 
lines 25-47). 

Chiu and Crill are combinable because they are both concerned with image pattern 
recognition methods. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to modify the input image and the template image of Chiu so that the 
resolution is reduced prior to the comparing step, as taught by Crill. The suggestion/motivation 
for doing so would have" been to increase the efficiency of the pattern recognition process (Crill, 
col. 1 7, lines 26-28). Therefore, it would have been obvious to combine Chiu with Crill to 
obtain the invention as specified in claim 8. 

Referring to claim 19, see the rejection of at least claim 8 above. 
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9. Claims 9-11, 20-22 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Krumm, U.S. Patent No. 6,61 1,622 ("Krum") and Lee et al., U.S. Patent No. 
6,678,404 ("Lee"), further in view of Mohan et al., U.S. Patent No. 6,3 10,964 ("Mohan"). 

Referring to claim 9, Krumm further discloses that the trained model comprises a sample 
image histogram comprising a gray value distribution of a sample image (col. 8, lines 46-58), 
and the step of comparing comprises the steps oft 

i. generating an input image histogram comprising a gray value distribution of the 
input image (col. 8, lines 40-47) 

ii. comparing the input image histogram with the sample image histogram (col. 8, 
lines 47-58) 

iii. determining if an object is present in the input image based on the comparison of 
the two histograms (col. 8, lines 58-62). 

Krumm does not explichly disclose that the object is a marker. Lee discloses the step of 
detecting a marker as noted above. ^ 

Krumm and Lee do not explicitly disclose that the step of comparing the input image 
histogram with the sample image histogram comprises computing a distance measure between 
the two. 

Mohan explains that it was exceedingly well known to compare two histograms by 
computing a distance measure between the two (col. 16, lines 50-60). 

Krumm, Lee, and Mohan are combinable because they are all concerned with detecting 
an object in an image. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to compare the histograms of Krumm and Lee with the method of 
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Mohan. The suggestion/motivation for doing so would have been to enhance the object 
recognition process (Mohan, col. 4, lines 26-35). Therefore, it would have been obvious to 
combine Krumm and Lee with Mohan to obtain the invention as specified in claim 9. 

Referring to claim 10, Krumm, Lee, and Mohan do not explicitly disclose that the step of 
generating an input image histogram comprises generating a global histogram. However, 
Official notice is taken that global histograms were exceedingly well known in the art. 
Therefore, it would have been obvious to modify the histogram of Krumm, Lee and Mohan so 
that it comprises a global histogram, in order to enhance the marker recognition process by 
providing a comprehensive representation of the input image. 

Referring to claim 1 1 , Krumm further discloses that the step of generating an input image 
histogram comprises generating a plurality of local histograms (col. 8, lines 53-58). 

Referring to claim 20, see the rejection of at least claim 9 above. 

Referring to claim 21, see the rejection of at least claim 10 above. 

Referring to claim 22, see the rejection of at least claim 1 1 above. 

10. Claims 23, 24 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Chiu et ah, U.S. Patent No. 5,696,838 ("Chiu") and Krumm, U.S. Patent No. 
6,611,622 ("Krum"). 

Referring to claim 23, Chiu discloses a system for recognizing a marker in an image, 
comprising: 

a. an image capture module for extracting image features associated with an input 
image of a ROI (col. 4, lines 23-32) 
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b. an image processor comprising a marker recognition processor for recognizing a 
marker in the input image based on a template recognition normalized correlation method that 
normalizes a template image and input image with respect to brightness (col. 5, lines 14-17 and 
col 8, lines 16-33) 

c. a database comprising trained template images which are used by the image 
processor during a recognition process (col. 6, lines 33-63). 

Chiu does not explicitly disclose a second marker recognition processor for recognizing a 
marker in the input image based on gray value histograms. However, this feature was 
exceedingly well known in the art. For example, Krumm discloses an object recognition 
processor for recognizing an object in an input image based on gray value histograms (col. 2, 
lines 40-61 and col. 19, lines 2-16). Krumm does not explicitly state that the object is a marker. 
However, Chiu's system is for detecting a marker in an image. Therefore, the combination of 
Chiu and Krumm provides a marker recognition processor based on gray value histograms. 

Chiu and Krumm are combinable because they are both concerned with objection 
recognition systems. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to include the histogram based recognition processor of Krumm, in the 
image processor of Chiu. The suggestion/motivation for doing so would have been to increase 
the flexibility of the system by providing the capability of recognizing the marker in the image 
using multiple recognition techniques. Therefore, it would have been obvious to combine Chiu 
with Krumm to obtain the invention as specified in claim 23. 

Referring to claim 24, Chiu further discloses that the system is implemented in an 
automated placement system for detecting markers on printed circuit boards (col. 6, lines 18-21). 
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Conclusion 


Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Charles Kim whose telephone number is 703-306-4038. The 
examiner can normally be reached on Mon thru Thurs 8:30am to 6pm and alternating Fri 9:30am 
to 6pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on 703-308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 


ck 

December 2, 2004 



